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ABSTRACT 


Particle swarm optimization is an evolutionary based computational technique used to solve the scheduling problems. Particle swarm optimization has few 
parameters to adjust, is easy to implement and has special characteristic of memory. This paper describes how the current literature uses the Particle 
swarm optimization approach to solve scheduling problems. An analysis of the literature allows one to conclude that Particle swarm optimization is one of 
the viable approaches to solve scheduling problems. On the basis of the literature review, we were not only able to derive certain guidelines for the 
implementation of Particle swarm optimization algorithms but also to determine possible directions for future research. 
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1. INTRODUCTION 


Particle Swarm Optimization (PSO) is an evolutionary computation technique, developed for optimization of continuous 
nonlinear, constrained and unconstrained, non-differentiable multi-modal functions (Kennedy et al. 1995). PSO is inspired 
firstly by general artificial life, the same as bird flocking, fish schooling and social interaction behaviour of human and 
secondly by random search methods of evolutionary algorithm (Jie et al. 2008). Animals, especially birds, fishes etc. always 
travel in a group without colliding, each member follows its group, adjust its position and velocity using the group information, 
because it reduces individual’s effort for search of food, shelter etc. Particle swarm optimization is evolutionary technique 
similar to genetic algorithm because both are population based and are equally affective. 

Particle swarm optimization has better computational efficiency, i.e. it requires less memory space and lesser speed of 
Central Processing Unit, it has less number of parameters to adjust. Genetic algorithm and other similar techniques (e.g. 
simulated annealing), work for discrete design variables, whereas particle swarm optimization works for discrete as well as 
analogue systems, because it is inherently continuous, does not need D/A or A/D conversion. Although for handling discrete 
design variables, Particle swarm optimization needs some modification to be done. 

In this paper PSO applied in the large field of computing, including the development of the algorithm is described in 
Section 2. Section 3 briefly reviews the standard equations of PSO which are usually related with engineering problems. The 
parameter tuning and its insights are dealt in section 4. Section 5 presents the categories of scheduling problems. Section 6 
explores the PSO algorithm tailed by over view of literature in section 7. 


2. CONCEPT OF PARTICLE SWARM OPTIMIZATION 


Human being have their own previous experiences, set beliefs and set rules of doing some work, based on which they take 
their actions (individual best position) also human follow the path set by society/group, this path is supposed to be the best 
according to the whole group (global best position) (Kennedy et al 1995). The essence for the development of particle swarm 
optimization was the assumption that potential solution to an optimization problem is treated as a point flying like bird in multi- 
dimensional space, adjusting its position in search space according to its own previous experience and that of its neighbour 
(Wei et al 2008). This point has got no mass and volume and is called a particle as it has velocity vector. As per Shi and 
Eberhart (Y. Shi et al 1998), to bring the particle to best position, initial velocity is incremented in either positive or negative 
direction depending on current value, if present position is less than best position then increase of velocity and vice versa is 
done (Kennedy et al. 1995). 


Vx = WxVx + C1 x rand x (Pbestx - Present) + C2 x rand x (Gbestx —Present;) (1) 
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Vx and present value have two matrices to show number of particles and dimensions. In the absence of previous velocity, 
particles will have no momentum and will get trapped in still position. C1 and C2 represent weighing of stochastic acceleration 
terms that pull particle towards Pbest and Gbest positions. Above equation has both cognizant parts (its own previous best 
value, derived from human behaviour of memory and experience) and social part (derived from human as well as animal 
behaviour to follow the path set by society or group). Population size is generally problem dependent and kept in between 20 
and 50 (Eberhart, 1995). 


3. MODIFIED EQUATION WITH ADDITION OF NEW OPERATORS (inertia weight and 


Constriction factor) 

To reach the target in a group of population, random numbers of particles are generated with random positions and random 
velocities. Their velocity vectors and positions are updated in number of iterations and then their fitness is calculated 
according to objective function (Hassan et al. 2004). Simulation is processed through simple equations (2) and (3) which are 
used as equations of standard particle swarm optimization (SPSO). The particle moves towards an optimum solution through 
its present velocity and its individual best solution obtained by itself in each iteration and global best solution is obtained by all 
particles. In a physical dimensional search space, updated position and velocity of the ‘i’ particle are represented as 


Viket = K(Vkix Wo + C1* Rix (P best(i) — Xki ) + Cox Rex (G best — Xxi )) (2) 
X ike = Xik + Vikot (3) 
Where Xi = [Xit, Xi2,. . ., Xia] 


Vi = [Vit, Vi2,. . ., Via), 

Here 1, 2... d shows possible dimensions for i = 1, 2. . . i particles with position X and velocity V. 

Pbest (i) = [Xi1 Pbest, Xi2 P best. . . XidP best] represent individual best positions of particle i. 

G best = [Xiabest, X2G best. . . XnG best] represent the global best positions. k represents the iteration number for total n iterations. 


w is inertia weight, K is constriction factor, C1 and C2 are non-negative coefficients called acceleration factors, Ri and Re are 
two random numbers different from each other and generally distributed in the range [0, 1]. 


In a simplified model taking into account only one dimension of particle P best and G best are combined into one single term, 
making convergence and divergence of a particle easy for some of the benchmark functions (Yasada et al. 2004). 


4. EFFECT OF PSO PARAMETERS IN PROBLEM SOLVING 


Searching for reaching success or optimization depends on selection of appropriate parameters and their tuning through the 
search process. A brief discussion of adjustment of parameters of particle swarm optimization is given in this section. 


4.1. Average and maximum velocity 

To converge to optimum point craziness or neighbour matching velocity concept was initially proposed, and then it is 
suggested to make an increment in desired direction by some random number. Average velocity gradually decreases, as a 
good solution tends to be obtained. Average velocity of large scale problem is larger than that of a small scale problem under 
the condition of same parameters. Success or failure of search is related to the average of absolute value of velocity 
(Yasada et al. 2004). Particle’s velocity in each direction is clamped to some maximum value Vmax, so that particles do not 
try to overpass the search space. Vmax is an important parameter to determine resolution; too high value may make the 
particle fly past the good solution and too low value will cause particles to be trapped in local minima, not allowing them to 
travel far places in search of good solution in the search space (R. C. Eberhart et al 2001). In early experiments Vmax was set 
at 10 — 20% of dynamic range of variable in each dimension. 


4.2. Inertia Weight 
Motivated by the desire to better control the scope of the search, reduce the importance of Vmax, and perhaps eliminate it 
altogether, the following modification of the PSO’s update equations was proposed (Shi and Eberhart 1998): 


~>> >: Oo > > > 
Vo vit U0,oy* (pr x) + U0,02)*( pe - x:), (4) 
Tee *F Vi, (5) 


Where w - inertia weight 


Note that if we interpret U(0,1) * ( pi- xi ) + U(0,@2) * ( pg- xi ) as the external force fi, acting on a particle, then the change in 
a particle’s velocity (i.e., the particle’s acceleration) can be written as vi= fi- (1 - w)vi. That is, the constant 1 - w acts 
effectively as a friction coefficient, and so w can be interpreted as the fluidity of the medium in which a particle moves. This 
perhaps explains why researchers have found that the best performance could be obtained by initially setting w to some 
relatively high value, which corresponds to a system where particles moves in a low viscosity medium and perform extensive 
exploration, and gradually reducing w to a much lower value, where the system would be more dissipative and exploitative 
and would be better at homing into local optima. It is even possible to start from values of w>1, which would make the swarm 
unstable, provided that the value is reduced sufficiently to bring the swarm in a stable region (the precise value of w that 
guarantees stability depends on the values of the acceleration coefficients. Naturally, other strategies can be adopted to 
adjust the inertia weight. For example, in (Eberhart and Shi 2000) the adaptation of w using a fuzzy system was reported to 
significantly improve PSO performance. Another effective strategy is to use an inertia weight with a random component, 
rather than time-decreasing. For example, (Eberhart and Shi, 2001) successfully used w = U (0.5, 1). 

With equation 5 and an appropriate choice of w and of the acceleration coefficients, gi: and 2, the PSO can be made 
much more stable,so much so that one can either do without Vmax or can set Vmax to a much higher value, such as the value of 
the dynamic range of each variable (on each dimension). In this case, Vmax may improve performance, though with use of 
inertia or constriction techniques, it is no longer necessary for damping the swarm’s dynamics. In the velocity updating 
process, the value of the parameters such as V, C1, Cz, K should be determined in advance. The inertia weight is linearly 
decreasing as the iteration proceeds and obtained as 
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a= a 
 — 
ee 


(6) 


Where @max: final inertia weight; min: initial inertia weight; iteration: current iteration number; iterationmax: maximum iteration 
number. 


5. SCHEDULING PROBLEMS 


Scheduling is broadly defined as the process of assigning a set of tasks to resources over a period of time or it may be 
defined as “the allocation of resources over time to perform a collection of tasks”. Scheduling problems in their simple static 
and deterministic forms are extremely simple to describe and formulate, but are difficult to solve because they involve 
complex combinatorial optimization. For example, if n jobs are to be performed on m machines, there are potentially (n!) m 
sequences, although many of these may be infeasible due to various constraints. 


5.1. Open Shop Scheduling 

Open shop scheduling problem (OSSP) is a scheduling problem where, given n jobs and m work stations, each job has to be 
processed on workstations at least once. However, some of these processing times may be zero. The order in which this 
happens is not relevant (in contrast to the job-shop problem, where the order of job does not matter). 


5.2. Flow-Shop Scheduling 

A flow-shop is a shop design in which machines are arranged in series Jobs begin processing on an initial machine, proceed 
through several intermediary machines, and conclude on a final machine. In each job exactly one operation for every 
machine, all jobs go through all the machines in the same order. 


5.3. Job-Shop Scheduling 

A job-shop does not have the same restriction on workflow as a flow-shop. In a job-shop, jobs can be processed on machines 
in any order. The usual job shop, from a research standpoint, is one in which there are m machines and rn jobs to be 
processed. Each job requires m operations, one on each machine, in a specific order, but the order can be different for each 
job. Real job-shops are more complicated. Jobs may not require all machines and yet they may have to visit some machines 
more than once. Clearly, workflow is not unidirectional in a job-shop. Any given machine may observe new jobs arriving from 
outside the shop (as new inputs), and from other machines within the shop (as WIP), the same machine may be the last 
machine for a particular job, or it may be an intermediate processing step. 


6. PARTICLE SWARM OPTIMIZATION ALGORITHM 


Each individual in the particle swarm is composed of three D-dimensional vectors, where D is the dimensionality of the search 
space. These are the current position Xi, the previous best position Pi, and the velocity Vi. The current position Xican be 
considered as a set of coordinates describing a point in space. On each iteration of the algorithm, the current position is 
evaluated as a problem solution. If that position is better than any that has been found so far, then the coordinates are stored 
in the second vector, Pi. The value of the best function result so far is stored in a variable that can be called Pbesti (for 
“previous best”), for comparison on later iterations. The objective is to keep finding better positions and updating Piand Pbesti. 
New points are chosen by adding Vicoordinates to Xi, and the algorithm operates by adjusting Vi, which can effectively be 
seen as a step size. 

The particle swarm is more than just a collection of particles. A particle by itself has almost no power to solve any 
problem; progress occurs only when the particles interact. Problem solving is a population-wide phenomenon, emerging from 
the individual behaviors of the particles through their interactions. In any case, populations are organized according to some 
sort of communication structure or topology, often thought of as a social network. The topology typically consists of 
bidirectional edges connecting pairs of particles, so that if j is in i’s neighborhood, i is also in j’s. Each particle communicates 
with some other particles and is affected by the best point found by any member of its topological neighborhood. This is just 
the vector pifor that best neighbor, which we will denote with pg. The potential kinds of population “social networks” are hugely 
varied, but in practice certain types have been used more frequently. In the particle swarm optimization process, the velocity 
of each particle is iteratively adjusted so that the particle stochastically oscillates around Piand Pglocations. The outline of the 
standard PSO process is as follows: 


Step 1: Initialize a population of particles with randompositions and velocities in a D-dimensional searchspace. 

Step 2: Update the velocity of each particle using Eq. (2). 

Step 3: Update the position of each particle using Eq. (3). 

Step 4: Map the position of each particle into the solutionspace and evaluate its fitness value according to thedesired 
optimization fitness function.Simultaneously update the pbest and gbestpositions if necessary. 

Step 5: Loop to Step 2 until the termination criterion is met, usually after a sufficient good fitness or a maximum number of 
iterations. 


7. OVERVIEW OF LITERATURE 


A hybrid particle swarm optimization (PSO) for the job shop problem (JSP) is proposed by D.Y. Sha, Cheng-Yu Hsu, 2006. 
Since the solution space of the JSP is discrete, they modified the particle position representation, particle movement, and 
particle velocity to better suit PSO for the JSP. They also modified the particle position based on preference list-based 
representation, the particle movement based on swap operator, and the particle velocity based on the concept of tabu list. 

Bo Liu, Ling Wang, Yi-Hui Jin (2007), proposed an effective hybrid algorithm based on particle swarm optimization 
(HPSO) for permutation flow shop scheduling problem (PFSSP) with the limited buffers between consecutive machines to 
minimize the maximum completion time (i.e., makespan). First, a novel encoding scheme based on random key 
representation is developed, which converts the continuous position values of particles in PSO to job permutations. Second, 
an efficient population initialization based on the famous Nawaz Enscore-Ham (NEH) heuristic is proposed to generate an 
initial population with certain quality and diversity. Third, a local search strategy based on the generalization of the block 
elimination properties, named block-based local search, is probabilistically applied to some good particles. Moreover, 
simulated annealing (SA) with multi-neighborhood guided by an adaptive meta-Lamarckian learning strategy is designed to 
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prevent the premature convergence and concentrate computing effort on promising solutions. Simulation results and 
comparisons demonstrate the effectiveness of the proposed HPSO. 

D.Y. Sha, Cheng-Yu Hsu (2007), presented a new particle swarm optimization (PSO) for the open shop scheduling 
problem. Compared with the original PSO, they modified the particle position representation using priorities, and the particle 
movement using an insert operator. They also implemented a modified parameterized active schedule generation algorithm 
(mP-ASG) to decode a particle position into a schedule. In mP-ASG, we can reduce or increase the search area between 
non-delay schedules and active schedules by controlling the maximum delay time allowed. 

Deming Lei (2008) presented a particle swarm optimization algorithm for solving multi-objective job shop scheduling 
problem. The objective is to simultaneously minimize makespan and total tardiness of jobs.l-Hong Kuo et al. (2009) used 
hybrid particle swarm optimization model named HPSO that combines random-key (RK) encoding scheme, individual 
enhancement (IE) scheme, and particle swarm optimization (PSO) is presented and used to solve the flow-shop scheduling 
problem (FSSP). The objective of FSSP is to find an appropriate sequence of jobs in order to minimize makespan. Makespan 
means the maximum completion time of a sequence of jobs running on the same machines in flow-shops.Changsheng Zhang 
et al. (2010) proposed a hybrid alternate two phases particle swarm optimization (PSO) algorithm called ATPPSO is proposed 
to solve the flow shop scheduling problem (FSSP) with the objective of minimizing makespan which combines the PSO with 
genetic operators and annealing strategy. 

A hybrid Alternate Two Phases Particle Swarm Optimization (ATPPSO) algorithm is proposed by Changsheng Zhang et 
al. (2010) to solve the flow shop scheduling problem (FSSP) with the objective of minimizing makespan which combines the 
PSO with genetic operators and annealing strategy. In the ATPPSO algorithm, each particle contains two states, the attractive 
state and the repulsive state. In order to refrain from the shortcoming of premature convergence, a two point reversal 
crossover operator is defined and in the repulsive process, each particle is repelled away from some inferior solution in the 
current tabu list to fly towards some promising areas which can introduce some new information to guide the swarm searching 
process. To preserve the swarm diversity, an annealing criterion is used to update the personal best of each particle. 
Moreover an easy understanding makespan computation method based on matrix is designed. Finally, the proposed 
algorithm is tested on different scale benchmarks and compared with the recently proposed efficient algorithms. The result 
shows that, both the solution quality and the convergence speed of the ATPPSO algorithm precede the other two recently 
proposed algorithms. It can be used to solve large scale flow shop scheduling problem effectively. 

The previous research on the job-shop scheduling problem has concentrated on finding a single objective optimization 
(e.g., makespan), even though the actual requirement of most production systems requires multi-objective optimization. The 
aim of D.Y. Sha et al. (2010) is to construct a particle swarm optimization (PSO) for an elaborate multi-objective job-shop 
scheduling problem. The original PSO was used to solve continuous optimization problems. Due to the discrete solution 
spaces of scheduling optimization problems, the authors modified the particle position representation, movement and its 
velocity in this study. The modified PSO was used to solve various benchmark problems. Test results demonstrated that the 
modified PSO performed better in search quality and efficiency than traditional evolutionary heuristics. 

Rui Zhang et al. (2012) proposed a two-stage particle swarm optimization (PSO) algorithm for SUSSP with the objective 
of minimizing the expected total weighted tardiness. In the first-stage PSO, a performance estimate is used for quick 
evaluation of the solutions, and a local search procedure is embedded for accelerating the convergence to promising regions 
in the solution space. The second-stage PSO continues the search process, but applies a more accurate solution evaluation 
policy, i.e. the Monte Carlo simulation. In order to reduce the computational burden, the optimal computing budget allocation 
(OCBA) method is used in this stage. 


8. CHARACTERISTICS OF PARTICLE SWARM OPTIMIZATION 


An Inertia weight w is a proportional agent that is related with the speed of last time, and the formula for the change of the 
speed is the following: 


Vids! =w vag + C1 (8) 


The influence of the last speed on the current speed can be controlled by inertia weights. When w values are higher, the 
PSO’s searching ability for the global solutions are higher and if w values are smaller, the searching ability remains partial. 
Generally, w is equal to 1, but during several generations, there is a lack of searching ability. Experimental results show that 
PSO has the biggest speed of convergence when w is between 0.8 and 1.2. While experimenting, w is confined from 0.9 to 
0.4 according to the linear decrease, which makes PSO search for the bigger space at the beginning and locate the position 
quickly where there is the most optimist solution. As w is decreasing, the speed of the particle will also slow down to search 
for the delicate partial. The method quickens the speed of the convergence, and the function of the PSO is improved. When 
the problem that is to be solved is very complex, this method makes PSO’s searching ability for the whole at the later period 
after several generation is not adequate, the most optimist solution cannot be found, so the inertia weights can be used to 
work out the problem. A PSO algorithm with convergence agents is introduced by Clerc M (1999) and the particle position and 
speed changes are 


Vid = X {Via + C1 rand ( )*(Pia- Xia)+C2 rand( )*(Pga- Xia)} (9) 
Convergence factor ¢=C1+C2>4 (10) 


Generally, gis equal to 4.1, so x is equal to 0.729. The experimental result shows compared with the particle swarm 
optimization algorithm with inertia weights, the convergence speed in the particle swarm optimization algorithm with the 
convergence agent is much quicker. In fact, when the proper w, Ci and Cz is decided, the two calculation methods are 
identical. So, the particle swarm optimization algorithm with convergence agent can be regarded as a special example of the 
particle swarm optimization algorithm with inertia weights. PSO can be used for both the single objective problems and the 
multi objective problems. 


8.1. Single objective problems 

Some of the authors considers any one of the objective functions and optimized the objective function using PSO. They are 

(i) Flow time (F)).It is the amount of time job / spends in system. 

(ii) Makespan (Cyax).It is the total amount of time for all jobs to finish processing 

(iii) Lateness (Lj. It is the amount of time by which the completion time differs from the due date. Positive lateness of a job 
means job is completed after the due date. 

(iv) Tardiness (Tj). It is the lateness of the job / if it fails to meet its due date, or zero. /.eT/= max {0, L} 
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Table 1 


Parameters of PSO in Scheduling Problems 
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8.2. Multi-objective problems 
Few authors demonstrates the capabilities of solving multiple objective problems by considering more than one of the below 


mentioned objectives. 

(i) Flow time (F/).It is the amount of time job / spends in system. 

(ii) Makespan(Cmax).It is the total amount of time for all jobs to finish processing 

(iii) Lateness (Lj). It is the amount of time by which the completion time differs from the due date. Positive lateness of a job 
means job is completed after the due date. 

(iv) Tardiness (Tj). It is the lateness of the job / if it fails to meet its due date, or sometimes it is zero. /.eT/= max {0, L} 

(v) Work load (Wy). It may be defined as the maximum load capacity that can be bear by a machine. 
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9. CONCLUSION 


Like other evolutionary algorithms, PSO has become an important tool for optimization and other complex problem solving. It 
is an interesting and intelligent computational technique for finding global minima and maxima with high capability or 
multimodal functions and practical applications. Particle swarm optimization works on theory of cooperation and competition 
between particles. This paper explores the capabilities of PSO in handling NP hard scheduling problems which also states the 
characteristics of PSO Parameters and its impact on rapid convergence to the optimal solutions. PSO has only few 
parameters than other heuristic algorithms, where most of the literature utilizes the similar values for these parameters as 
shown in the Table 1. Yet PSO is a promising method working in the direction of simulation and optimization of difficult 
engineering and other problems. Further analysis of the comparative potency of PSO, and the problems in using a PSO 
based system are needed. 
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